Computational Nonlinear Stochastic Control based on the Fokker-Planck-Kolmogorov Equation
نویسنده
چکیده
The optimal control of nonlinear stochastic systems is considered in this paper. The central role played by the Fokker-Planck-Kolmogorov equation in the stochastic control problem is shown under the assumption of asymptotic stability. A computational approach for the problem is devised based on policy iteration/ successive approximations, and a finite dimensional approximation of the control parametrized diffusion operator, i.e., the controlled FokkerPlanck operator. Several numerical examples are provided to show the efficacy of the proposed computational methodology.
منابع مشابه
(Preprint) AAS INFORMATION THEORETIC SPACE OBJECT DATA ASSOCIATION METHODS USING AN ADAPTIVE GAUSSIAN SUM FILTER
This paper shows an approach to improve the statistical validity of orbital estimates and uncertainties as well as a method of associating measurements with the correct space objects. The approach involves using an adaptive Gaussian mixture solution to the Fokker-Planck-Kolmogorov equation for its applicability to the space object tracking problem. The Fokker-Planck-Kolmogorov equation describe...
متن کاملOptimal Receding Horizon Filter for Continuous-Time Nonlinear Stochastic Systems
A receding horizon filtering problem for nonlinear continuous-time stochastic systems is considered. The paper presents the optimal receding horizon filtering equations. Derivation of the equations is based on the Kushner-Stratonovich and Fokker-Planck-Kolmogorov equations for conditional and unconditional density functions. This result could be a theoretical basis for the optimal control in no...
متن کاملFokker-planck Equations: Uncertainty in Network Security Games and Information
We have significant accomplishments on uncertainty quantification in inverse problems for dynamical systems, generalized sensitivity and optimal design of experiments, elasticity and viscoelasticity modeling for buried target detection, and general inverse problem methodology for proliferating populations. Our efforts have continued on development of efficient accurate integration of Fokker Pla...
متن کاملA unifying formulation of the Fokker-Planck-Kolmogorov equation for general stochastic hybrid systems
A general formulation of the Fokker-Planck-Kolmogorov (FPK) equation for stochastic hybrid systems is presented, within the framework of Generalized Stochastic Hybrid Systems (GSHS). The FPK equation describes the time evolution of the probability law of the hybrid state. Our derivation is based on the concept of mean jump intensity, which is related to both the usual stochastic intensity (in t...
متن کاملEstimating parameters in diffusion processes using an approximate maximum likelihood approach
We present an approximate Maximum Likelihood estimator for univariate Itô stochastic differential equations driven by Brownian motion, based on numerical calculation of the likelihood function. The transition probability density of a stochastic differential equation is given by the Kolmogorov forward equation, known as the Fokker-Planck equation. This partial differential equation can only be s...
متن کامل